Reverberation-Robust Online Multi-Speaker Tracking by Using a Microphone Array and CASA Processing
نویسندگان
چکیده
Online tracking of speakers is an important task for applications in smart environments such as camera control, meeting annotation and speech separation. Challenges for an audio-only system are small-room reverberation, noise, the unknown number of speakers, and gaps occurring in natural speech. Combining models from neurobiology and cognitive psychology with many-channel signal processing and pattern recognition techniques, a hybrid method was developed. By employing online CASA processing to signals from a microphone array, the real-time capable method is able to track an arbitrary number of concurrent moving speakers in highly reverberant environments.
منابع مشابه
Towards Robust Speech Acquisition using Sensor Arrays
An integrated system approach was developed to address the problem of distant speech acquisition in multi-party meetings, using multiple microphones and cameras. Microphone array processing techniques have presented a potential alternative to close-talking microphones by providing speech enhancement through spatial filtering and directional discrimination. These techniques relied on accurate sp...
متن کاملRobust Speaker Localization Utilizing a Novel Beamforming Algorithm Based on Harmonic Structures
Speaker localization by microphone array has recently received significant attention. Although various methods have been proposed; their performance with short data segments under noise and reverberation degrades considerably. Sound localization based on Steered Response Power (SRP) shows more robustness in practical situations especially with the use of short data segments. In SRP-PHAT algorit...
متن کاملMulti-Microphone Noise Reduction - Theoretical Optimum and Practical Realization
In speech processing systems with large speaker to microphone distance such as hearing aids or hands-free telephony the recorded speech signal is often heavily corrupted by additive acoustic background noise. Microphone arrays can significantly improve the received speech quality by extracting the desired speech source and suppressing disturbing background noise and reverberation. High performa...
متن کاملMultiple moving speaker tracking by microphone array on mobile robot
Real-world applications often require tracking multiple moving speakers for improving human-robot interactions and/or sound source separation. This paper presents multiple moving speaker tracking using an 8ch microphone array system installed on a mobile robot. This problem is difficult because the system does not assume that sound sources and/or the microphone array are fixed. Our solutions co...
متن کاملContinuous Microphone Array Speech Recognition on Wall Street Journal Corpus
In this paper, we present a robust speech acquisition system to acquire continuous speech using a microphone array. A microphone array based speech recognition system is also presented to study the environmental interference due to reverberation, background noises and mismatch between the training and testing conditions. This is important in the context of smart meeting rooms of Augmented Multi...
متن کامل